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ABSTRACT 


This  paper  focuses  on  a probabilistic  generative  model  that  concurrently  tackles  the  problems  of  image  retrieval  and  region-of-interest  (ROI)  segmentation.  In  this 
paper  two  main  properties  of  matching  process  are  discussed,  namely:  1)  objects  undergoing  a geometric  transformation,  typical  spatial  location  of  the  region  of  inter- 
est & 2)  visual  similarity.  These  two  properties  used  in  our  approach  improve  the  reliability  of  detected  true  matches  between  any  pair  of  images.  Furthermore,  by  tak- 
ing advantage  of  the  links  to  the  ROI  provided  by  the  true  matches,  the  proposed  method  is  able  to  perform  a suitable  ROI  segmentation.  Finally,  the  proposed  method 
is  able  to  work  when  there  is  more  than  one  ROI  in  the  query  image.  With  this  experiments  on  two  challenging  image  retrieval  datasets,  proved  that  our  approach 
clearly  outperforms  the  most  prevalent  approach  for  geometrically  constrained  matching. 

Furthermore,  the  proposed  technique  concurrently  provides  very  good  segmentations  of  the  ROI  Image  segmentation  and  object  detection  in  multi-object  image 
retrieval  tasks. 
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I.  INTRODUCTION 

An  image  retrieval  system  is  a computer  system  for  browsing,  searching  and 
retrieving  images  from  large  database  of  digital  images.  The  purpose  of  an  image 
database  is  to  store  and  retrieve  an  image  or  image  sequences  that  are  relevant  or 
similar  to  a query  image.  There  are  problems  finding  reliability  of  detected  true 
matches  between  any  pair  of  images.  By  taking  consideration  of  ROI  provided 
by  true  matches,  it  can  be  able  to  perform  a suitable  ROI  segmentation. 

The  system  represents  a geometric-aware  matching  that  relies  on  a probabilistic 
mixture  model  to  concurrently  solve  both  image  retrieval  and  ROI  segmentation 
problems.  Our  proposal  provides  a unified  framework  that  takes  into  account 
three  kinds  of  constraints:  spatial  coherency  between  points  belonging  to  the 
same  object,  underlying  geometric  transformations  between  matched  objects, 
and  visual  similarity  between  matched  points.  As  a result,  the  proposed  method 
naturally  provides  segmentation  mask  identifying  the  ROI  in  the  query  image. 
Our  method  focuses  on  the  matching  process  between  a query  image  and  a set  of 
reference  images.  Our  method  models  the  transformation  between  objects 
appearing  in  two  images. 

II.  PREVIOUS  WORK 

[1]  Prototype-based  image  search  reranking  ( L.  Yang  and  A.  Hanjalic,  IEEE, 
Jun.  2012):-  This  paper  focuses  on  Image  Search  Re-ranking  Based  on  Pro- 
totype a prototype  based  method  to  learn  reranking  function  from  human 
labeled  samples.  Based  on  images  obtained  in  initial  search  result,  visual  pro- 
totype will  be  generated.  Each  prototype  is  used  to  construct  a Meta  reranker 
to  produce  a reranking  score  for  any  other  image  from  initial  set.  Finally  all 
scores  from  all  metarerankers  are  aggregated.  For  visual  reranking  author 
used  S VM  algorithm. 

[2]  Large-scale  image  retrieval  with  compressed  fisher  vectors  (F.  Perronnin,  Y. 
Liu,  J.  Sanchez,  and  H.  Poirier  IEEE):  - This  paper  implementation  primarily 
focuses  to  use  the  Fisher  kernel  framework.  Author  compress  Fisher  vectors 
to  reduce  their  memory  footprint  and  speed-up  the  retrieval  & shown  on  two 
publicly  available  datasets  that  compressed  Fisher  vectors  perform  very 
well  using  as  little  as  a few  hundreds  of  bits  per  image,  and  significantly 
better  than  a very  recent  compressed  BOV  approach. 

Based  on  the  above  literature  review  there  are  several  properties  of  matching  pro- 
cess between  two  objects  in  different  images,  like  objects  undergoing  a geometri- 
cal transformation,  typical  spatial  location  of  region  of  interest  and  visual  simi- 
larity. From  our  point  of  view,  the  proposed  method  provides  three  main  benefits 
with  respect  to  traditional  retrieval  approaches:  first,  the  segmentation  of  the  ROI 
may  be  useful  in  many  applications  (e.g.  video  editing);  second,  it  improves  the 
retrieval  process  by  enforcing  the  matches  to  fulfill  a set  of  geometric  con- 
straints; and,  third,  using  a mixture  model  to  represent  the  matching  process 
allows  us  to  consider  more  than  one  image  region  being  matched  in  a reference 
image.  It  successfully  addresses  several  problems  of  interest  in  computer  vision, 
such  as  multi-object  retrieval,  detection  and  segmentation,  or  multi  view 
retrieval.  The  above  mentioned  system  inspired  me  to  make  an  attempt  to  pro- 
vide a comprehensive  assessment  of  the  method  in  new  scenarios  of  application. 


II.  PROPOSED  METHOD 

This  proposed  system  implementing  the  Segmentation  of  Region  of  Interest 
(ROI)  from  query  image  by  using  MATLAB  Image  processing  tool  box.  It  is  then 
proposed  to  remove  the  unwanted  part  except  ROI  from  Image.  This  proposed 
system  then  find  match  between  ROI  image  and  different  images  in  Data  base. 


Fig.l.  Block  diagram  of  the  proposed  method 

First  input  (query)  image  is  selected  and  using  Median  filter  noise  is  eliminated. 
Harris  comer  detection  method  is  used  for  edge  detection,  selected  seed  points 
are  located.  ANFIS  (Adaptive  Neuro  Fuzzy  Interference  System)  is  used  For 
ROI  segmentation.  Segmented  output  is  available  which  is  further  used  as  a 
query  image  to  find  its  match  in  the  database. 

1)  Filtering:  Using  Median  filter  the  RGB  three  colors  of  the  image  pixels  are 
filtered.  Hence  we  get  the  filtered  RGB  image. 

2)  ROI:  The  Harris  comer  detector  is  a popular  interest  point  detector  due  to  its 
strong  invariance  to:  rotation,  scale,  illumination  variation  and  image  noise. 
The  Harris  comer  detector  is  based  on  the  local  auto-correlation  function  of 
a signal;  where  the  local  auto-correlation  function  measures  the  local 
changes  of  the  signal  with  patches  shifted  by  a small  amount  in  different 
directions.  A discrete  predecessor  of  the  Harris  detector  was  presented  by 
Moravec;  where  the  discreteness  refers  to  the  shifting  of  the  patches. 

Change  of  intensity  for  the  shift  [u,v] : 

E(u,  v)  = yV-(.r,  y)[l(x+u,y + v)  - I(x,y)f 

jtj 
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3)  Segmentation:  A)  for  segmentation  ANFIS  is  used.  The  human  mind  can  be 
considered  to  be  a role  model  for  soft  computing.  Soft  computing  may  be 
considered  to  be  comprising  of  different  methodologies  with  Neuro- 
computing (NC),  the  Fuzzy  logic  (FL)  and  the  Genetic  algorithm  (GA)  as 
the  principal  partners.  Therefore  in  soft  computing  based  system  identifica- 
tion, instead  of  a single  standard  method,  a collection  of  techniques  has  been 
put  forward  as  possible  solutions  to  the  identification  problem.  They  can  be 
broadly  grouped  as  neural  network  based  algorithm,  fuzzy  logic  based  algo- 
rithm and  the  genetic  algorithm.  The  neural  network  has  the  inherent  advan- 
tage of  being  able  to  adapt  itself  and  also  in  its  learning  capabilities. 

Similarly  the  salient  feature  that  is  associated  with  the  fuzzy  logic  is  the  distinct 
ability  to  take  into  account  the  prevailing  uncertainty  and  imprecision  of  real  sys- 
tems with  the  help  of  the  fuzzy  if-then  rules.  In  order  to  exploit  the  advantage  of 
the  self  adaptability  and  learning  capability  of  the  neural  network  and  the  capa- 
bility of  the  fuzzy  system  to  take  into  account  of  the  prevailing  uncertainty  and 
imprecision  of  real  systems  with  the  help  of  the  fuzzy  if-then  rules,  an  integrated 
forecasting  approach  comprising  of  both  the  fuzzy  logic  and  the  neural  network 
has  been  considered.  This  hybrid  system  is  called  the  Adaptive  network  based 
fuzzy  inference  system. 

Aneuro-fuzzy  technique  called  Adaptive  network  based  fuzzy  inference  system 
(ANFIS)  has  been  used  as  a prime  tool  in  the  present  work.  ANFIS  is  a neuro 
fuzzy  technique  where  the  fusion  is  made  between  the  neural  network  and  the 
fuzzy  inference  system.  In  ANFIS  the  parameters  can  be  estimated  in  such  a way 
that  both  the  Sugeno  and  Tsukamoto  fuzzy  models  are  represented  by  the  ANFIS 
architecture.  The  fuzzy  logic  takes  into  account  the  imprecision  and  uncertainty 
of  the  system  that  is  being  modeled  while  the  neural  network  gives  it  a sense  of 
adaptability.  Using  this  hybrid  method,  at  first  an  initial  fuzzy  model  along  with 
its  input  variables  are  derived  with  the  help  of  the  rules  extracted  from  the  input 
output  data  of  the  system  that  is  being  modeled.  Next  the  neural  network  is  used 
to  fine  tune  the  rules  of  the  initial  fuzzy  model  to  produce  the  final  ANFIS  model 
of  the  system.  In  this  proposed  work  ANFIS  is  used  as  the  backbone  for  the  iden- 
tification of  real  world  systems. 

B)  ANFIS  structure: 

For  simplicity,  it  is  assumed  that  the  fuzzy  inference  system  under  consideration 
has  two  inputs  and  one  output.  The  rule  base  contains  the  fuzzy  if-then  rules  of 
Takagi  and  Sugeno's  type  as  follows: 

If  x is  A and  y is  B then  z is  f(x,  y) 

Where  A and  B are  the  fuzzy  sets  in  the  antecedents  and  z=f(x,  y)  is  a crisp  func- 
tion in  the  consequent.  Usually  f(x,  y)  is  a polynomial  for  the  input  variables  x 
and  y.  But  it  can  also  be  any  other  function  that  can  approximately  describe  the 
output  of  the  system  within  the  fuzzy  region  as  specified  by  the  antecedent.  When 
f(x,  y)  is  a constant,  a zero  order  Sugeno  fuzzy  model  is  formed  which  may  be  con- 
sidered to  be  a special  case  of  Mamdani  fuzzy  inference  system  [144]  where  each 
rule  consequents  specified  by  a fuzzy  singleton.  If  f(x,  y)  is  taken  to  be  a first 
order  polynomial  a first  order  Sugeno  fuzzy  model  is  formed.  For  a first  order 
two  rule  Sugeno  fuzzy  Inference  system,  the  two  rules  may  be  stated  as 

Rule  l:IfxisAl  andyisBl  thenfl=plx+qly+rl 

Rule  2:  Ifx  is  A2  and  y is  B2  then  f2=p2x+q2y+r2 

Here  type-3  fuzzy  inference  system  proposed  by  Takagi  and  Sugeno  is  used.  In 
this  inference  system  the  output  of  each  rule  is  a linear  combination  of  the  Input 
variables  added  by  a constant  term.  The  final  output  is  the  weighted  average  of 
each  rule's  output. 

IV.  RESULTS 

The  system  gives  a generative  probabilistic  Model  that  concurrently  tackles 
image  retrieval  and  ROI  segmentation  problems.  By  jointly  modeling  several 
properties  of  true  matches,  namely  : objects  undergoing  a geometric  transforma- 
tion, typical  spatial  location  of  the  region  of  interest,  and  visual  similarity,  our 
approach  improves  the  reliability  of  detected  true  matches  between  any  pair  of 
images. 


Fig.l)  Image  Database 


Fig.2)  Input  image 


Fig.3)  filtered  RGB  image 
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V.  CONCLUSION 

This  paper  focuses  on  reliability  of  detected  true  matches  between  any  pair  of 
images.  Furthermore,  the  proposed  method  associates  the  true  matches  with  any 
of  the  considered  foreground  components  in  the  image  and  assigns  the  rest  of  the 
matches  to  a background  region,  to  perform  a suitable  ROI  segmentation. 


I 

Fig.4)  segmentation 
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Fig.5)  segmentated  ROI 


International  Education  & Research  Journal  [IERJ] 


46 


